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purpose  and  what  things  are  for.  Consequently,  jve  want  vision  systems  to  use 
functional  descriptions  to  identify  things,  when  necessary,  and^we  want  them  to 
learn  physical  descriptions  for  themselves,  when  possible. 


This  paper  describes  a  theory  that  explains  how  to  make  such  systems  work.  The 
theory  is  a  synthesis  of  two  sets  of  ideas:  ideas  about  learning  from  precedents 
and  exercises  developed  at  MIT  and  ideas  about  physical  description  developed 
at  Stanford.  The  strength  of  the  synthesis  is  illustrated  by  way  of  representative 
experiments.  All  of  these  experiments  have  been  performed  with  an  implemented 
system. 


This  research  was  done  in  part  at  the  Artificial  Intelligence  Laboratory  of  the 
Massachusetts  Institute  of  Technology  and  in  part  at  the  Artificial  Intelligence 
Laboratory  of  Stanford  University.  Support  for  MIT’s  artificial-intelligence  research 
is  provided  in  part  by  the  Advanced  Research  Projects  Agency  of  the  Department 
of  Defense  under  Office  of  Naval  Research  contract  N00014-80-C-0505. 


*  Thomas  O.  Binford  and  Michael  Lowry  are  at  the  Stanford  University  Artificial 
Intelligence  Laboratory.  This  paper  is  also  available  from  Stanford  University  as 
report  STAN-CS-82-950,  also  known  as  AIM  349. 


Figure  1.  A  cup  with  a  handle. 


Key  Ideas 

It  is  too  hard  to  tell  vision  systems  what  things  look  like.  It  is  easier  to  talk  about 
purpose  and  what  things  are  for.  Consequently,  we  want  vision  systems  to  use 
functional  descriptions  to  identify  things,  when  necessary,  and  we  want  them  to 
learn  physical  descriptions  for  themselves,  when  possible. 

For  example,  there  are  many  kinds  of  cups:  some  have  handles,  some  do  not; 
some  have  smooth  cylindrical  bodies,  some  are  fluted:  some  are  made  of  porcelain, 
others  are  styrofoam,  and  still  others  are  metal.  You  could  turn  blue  in  the  face 
describing  all  the  physical  possibilities.  Functionally,  however,  all  cups  are  things 
that  are  easy  to  drink  from.  Consequently,  it  is  much  easier  to  convey  what  cups 
are  by  saying  what  they  are  functionally. 

To  be  more  precise  about  what  we  are  after,  imagine  that  you  are  told  cups  are 
open  vessels,  standing  stably,  that  you  can  lift.  You  see  that  the  object  in  figure 
1  has  a  handle,  an  upward  pointing  concavity,  and  a  fiat  bottom.  You  happen  to 
know  it  is  light.  Because  you  already  know  something  about  bowls,  bricks,  and 
suitcases,  you  conclude  that  you  are  looking  at  a  cup.  You  also  create  a  physical 
model  covering  this  particular  cup  type. 

Our  first  purpose,  then,  is  to  explain  how  physical  identification  can  be  done 
using  functional  definitions.  Our  second  purpose  is  to  show  how  to  learn  physical 
models  using  functional  definitions  and  specific  acts  of  identification. 

It  is  important  to  note  that  our  theory  of  model  learning  involves  a  physical 
example  and  some  precedents  in  addition  to  the  functional  definition: 

■  The  physical  example  is  essential,  for  otherwise  there  would  be  no  way  to  know 

which  precedents  are  relevant 


A 


■  The  precedents  arc  essential.  Ibr  otherwise  there  would  be  no  way  to  know 
which  aspects  of  the  physical  example  are  relevant 

We  now  proceed  to  explain  our  function-to-form  theory  and  to  illustrate  the 
ideas  using  some  examples  that  have  been  run  through  our  implementation. 

Learning  by  Analogy'  and  Constraint  Transfer 

We  begin  by  reviewing  the  sort  of  tasks  performed  by  the  system  that  embodies 
the  theory  of  learning  by  analogy  and  constraint  transfer.  For  details,  see  Winston 
[1981]. 

•  A  natural  language  interface  translates  English  sentences  describing  a  precedent 
and  a  problem  into  links  in  a  semantic  net 

The  input  English  interface  was  conceived  and  written  by  Katz.  For  details,  see 
Katz  and  Winston  (1982). 

•  A  matcher  determines  a  correspondence  between  the  parts  of  the  precedent  and 
the  problem.  Figure  2  illustrates. 

•  An  unalogizer  determines  if  the  questioned  link  in  the  problem  is  supported  by 
the  given  links  in  the  problem.  To  do  this,  the  analogizer  transfers  the  CAUSE 
links  supplied  by  the  precedent  onto  the  problem.  Figure  3  illustrates. 

•  A  rule  generator  constructs  an  ;f-then  rule  to  capture  that  portion  of  the  causal 
structure  in  the  precedent  that  is  ferreted  out  by  the  problem.  Ihe  then  part 
of  the  if-then  rule  comes  from  the  questioned  link  in  the  problem.  The  if  parts 
come  from  links  identified  by  the  transferred  CAUSE  structure. 

Thus  the  rules  look  like  this: 

Rule 

RULE-1 

if 

link  found  using  CAUSE  structure 
link  found  using  CAUSE  structure 


then 

link  to  be  shown  to  hold 

case 

names  of  all  precedents  used 

In  more  complicated  situations,  no  single  precedent  can  supply  enough  causal 
structure.  Consequently,  several  precedents  must  be  strung  together.  A  new  precedent 
is  sought  whenever  there  is  a  path  in  the  transferred  CAUSE  structure  that  does 
not  lead  to  an  already  established  link  in  the  problem.  The  examples  in  this  paper 
all  use  multiple  precedents. 

Object  Modeling  and  Recognition  using  ACRONYM 

We  continue  b^  reviewing  the  contents  of  ACRONYM,  a  recognition-oriented 
modeling  system.  For  details,  see  Binford  [19821. 


Precedent 


Problem 


Figure  2.  The  matcher  determines  part  correspondence  using  the  links  that  populate  the  precedent 
and  the  problem,  lhc  matcher  pays  particular  attention  to  links  that  arc  enmeshed  in  the  CAUSE 
structure  of  the  precedent 

•  ACRONYM  uses  generalized  cylinders  to  describe  how  objects  fill  space. 


A  generalized  cylinder  is  formed  when  a  planar  cross  section  moves  along  a  curve  in 
space,  sweeping  out  a  \olume.  The  size  of  the  planar  cross  section  may  change  as  it 
moves.  The  angle  between  the  planar  cross  section  and  the  curve  is  held  constant, 
typically  at  90°.  Figure  4a  shows  some  examples. 


•  ACRONYM  uses  ribbons  and  ellipses  to  represent  what  a  viewer  sees. 

Ribbons  are  two-dimensional  analogs  to  generalized  cylinders.  A  ribbon  is  formed 
when  a  line  is  moved  along  a  two-dimensional  curve,  perhaps  changing  size  as  it 
moves.  The  angle  between  the  line  and  the  curve  is  held  constant,  typically  at  90°. 
Figure  4b  shows  some  examples. 


Precedent 


Problem 


o 


cause 

relation 


relation  ? 


Transferred 
cause  relation 


Figure  3.  Hie  aiulogi/cr  transfers  CAUSE  constraints  from  the  precedent  to  the  problem.  The 
problem  is  solved  if  links  in  the  problem  match  the  links  carried  along  with  the  transferred 
CAL'SH  structure.  In  this  simple  illustration,  there  is  only  one  CAUSH  link.  This  CAUSE  link 
leads  from  the  link  to  be  shown  to  a  link  that  already  holds. 


•  ACRONYM  predicts  what  objects  will  look  like  from  given  points  of  view. 

To  make  predictions,  descriptions  in  the  form  of  generalized  cylinders  are  translated 
into  descriptions  in  the  form  of  ribbons  and  ellipses.  Tolerances  attached  to  the 
generalized  cylinder  descriptions  are  translated  to  tolerances  attached  to  the  ribbon- 
and-ellipse  descriptions.  Prediction  requires  a  great  deal  of  complicated  algebraic 
and  vector  manipulation. 

•  ACRONYM  allows  top-down  prediction  to  supervise  bottom-up  analysis. 

Given  some  gencr  li/ed  cylinders  and  a  point  of  view,  ACRONYM  can  determine 
what  ribbon  and  ellipse  shapes  and  sizes  to  look  for.  Once  a  few  major  shapes 


•tihcmc 


Figure  4.  Part  a  shows  some  examples  of'  generalized  cylinders.  Part  b  shows  ribbons  and  ellipses 
corresponding  to  die  objects  in  part  a. 

are  found,  the  determination  can  be  quite  specific,  not  only  about  shape  and  size, 
but  also  about  position.  Having  found  the  ribbon  corresponding  to  the  body  of  an 
airplane,  for  example,  it  is  possible  to  predict  the  location,  orientation,  and  size  of 
the  ribbons  corresponding  to  the  wings. 

Brooks's  landmark  thesis  concentrated  on  exactly  this  sort  of  prediction  [Brooks 
1981J. 

In  principle,  prediction  knowledge  can  be  used  to  condition  the  earliest  vision 
procedures  to  the  situation  at  hand.  Jn  current  practice,  early  vision  procedures 
operate  autonomously  up  to  the  level  where  ribbons  and  ellipses  are  formed.  Efforts 
are  underway  to  push  predictions  further  toward  the  pixels. 
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The  Synthesis 

In  this  section,  we  briefly  describe  the  steps  involved  in  our  synthesis  of  the 
learning  of  ANALOGY  and  the  physical  representations  of  ACRONYM.  In  the 
next  section  we  illustrate  the  steps  by  explaining  a  particular  scenario  in  which  the 
identification  and  learning  system  recognizes  one  physical  model  of  a  cup,  expressed 
in  ACRONYM'S  representation  primitives,  and  then  creates  a  model,  in  the  form 
of  an  if-then  rule,  for  that  kind  of  cup.  Here  then  are  the  steps  in  the  synthesis: 

1.  Describe  the  thing  to  be  recognized  in  functional  terms. 

The  functional  description  is  given  in  English  and  translated  into  semantic  net  links. 

2.  Show  a  physical  example. 

At  the  moment,  the  physical  description  is  given  in  English,  bypassing  vision. 
The  description  is  couched  in  the  generalized-cylinder  vocabulary  of  ACRONYM, 
however.  E\entually  this  discription  will  come  optionally  from  ACRONYM. 

3.  Enhance  the  physical  example's  physical  description. 

The  basic  physical  description,  produced  either  from  English  or  from  an  image, 
occasionally  r  'quires  English  enhancement.  English  enhancement  is  required  when 
there  is  a  need  to  record  physical  properties  such  as  material  composition,  weight, 
and  articulation,  which  are  not  easily  obtained  from  a  vision  system  or  a  vision-system 
prosthesis. 

4.  Show  that  the  functional  requirements  are  met  by  the  enhanced  physical 
description,  thus  identifying  the  object. 

ANALOGY  does  this  using  precedents.  Several  precedents  are  usually  necessary  to 
show  that  all  of  the  functional  requirements  are  met. 

5.  Create  a  physical  model  of  the  functionally-defined  concept 

ANALOGY  creates  a  physical  model  in  the  form  of  an  if-then  rule  whenever  it 
successfully  shows  that  a  concept  s  functional  requirements  are  met  by  a  particular 
physical  example.  Since  functional  requirements  usually  can  be  met  in  a  number  of 
ways,  there  may  be  a  number  of  physical  models,  each  generated  from  a  different 
physical  example. 

Once  if-then  based  physical  models  are  learned,  examples  of  the  concept  can  be 
recognized  directly,  without  reference  to  functional  requirements  or  to  precedents. 
Moreover.  ACRONYM  can  use  the  learned  physical  models  to  make  top-down 
predictions  about  what  things  will  be  seen  so  that  bottom-up  procedures  can  look 
for  those  things. 

Learning  What  an  Ordinary  Cup  Looks  Like 

Now  let  us  walk  through  the  steps  of  the  learning  process,  showing  how  to  learn 
what  an  ordinary  cup  looks  like. 

The  first  step  is  to  describe  the  cup  concept  in  terms  of  functional  qualities  such 
as  liftability,  stab!'  ty,  and  ability  to  serve  as  an  accessible  container.  This  is  done 
by  way  of  the  following  English: 


open-vessel 

stable 

liftable 


Figure  5.  The  functional  definition  of  a  cup.  This  semantic  net  is  produced  using  an  English 
description.  AKO  =  A  Kind  Of.  HQ  =  Has  Quality. 

Let  X  be  a  definition.  X  is  a  definition  of  an  object  The 
object  is  a  cup  because  it  is  stable,  because  it  is  liftable, 
and  because  it  is  an  open-vessel.  Remember  X. 

Of  course,  other,  more  elaborate  definitions  are  possible,  but  this  one  seems  to 
us  to  be  good  enough  for  the  purpose  of  illustrating  our  learning  theory. 

The  English  is  translated  into  the  semantic  net  shown  in  figure  5. 

The  next  step  is  to  show  an  example  of  a  cup,  such  as  the  one  in  figure  6a. 
ACRONYM  is  capable  of  translating  such  visual  information  into  the  semantic  net 
shown  in  figure  6b.  But  inasmuch  as  our  connection  to  ACRONYM  is  not  complete, 
we  currently  bypass  ACRONYM  by  using  the  following  English  instead. 

Let  E  be  an  exercise.  E  is  an  exercise  about  a  red 
object.  The  object’s  body  is  small.  The  object’s  bottom 
is  flat.  The  object  has  an  upward-pointing  concavity. 

The  object  has  a  handle. 

In  contrast  to  the  definition,  the  qualities  involved  in  the  description  of  the 
particular  cup  are  all  physical  qualities,  not  functional  ones.  (Assume  that  all 
qualities  involving  scales,  like  small  size  and  light  weight,  are  relative  to  the  human 
body,  by  default,  unless  otherwise  indicated.) 

In  the  next  step,  we  enhance  the  physical  example  s  physical  description.  This 
enables  us  to  specify  physical  properties  and  links  that  are  not  obtainable  from 
vision. 

The  object  is  light. 

Now  it  time  U'  .tow  that  the  functional  requirements  are  met  by  the 
enhanced  phy.vc  1  c.  criplion.  To  do  this  requires  using  precedents  relating  the 
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The  ' 

object  is  light 


V 


Figure  6.  A  particular  cup,  together  with  a  semantic-net  description  of  its  physical  appearance. 
Most  of  the  semantic  net  can  he  produced  by  ACRONYM  working  from  an  image.  Some  nonvisual 
details  must  be  pro'1  .ccd  by  working  through  the  natural  language  interface. _ 
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cup  s  functional  descriptors  to  observed  and  stated  physical  descriptors.  Three 
precedents  are  used.  One  indicates  a  way  an  object  can  be  determined  to  be  stable; 
another  relates  liftability  to  weight  and  having  a  handle;  and  still  another  explains 
what  being  an  open-vessel  means.  All  contain  one  thing  that  is  irrelevant  with 
respect  to  dealing  with  cups;  these  irrelevant  things  are  representative  of  the  detritus 
that  can  accompany  the  useful  material. 

Let  X  be  a  description.  X  is  a  description  of  a  brick. 

The  brick  is  stable  because  the  brick's  bottom  is  flat 

The  brick  is  hard. 

Remember  X. 

Let  X  be  a  description.  X  is  a  description  of  a  suitcase. 

The  suitcase  is  liftable  because  it  is  graspable  and  because 
it  is  light.  The  suitcase  is  graspable  because  it  has  a 
handle. 

The  suitcase  is  useful  because  it  is  a  portable  container 
for  clothes. 

Remember  X. 

Let  X  be  a  description.  X  is  a  description  of  a  bowl. 

The  bowl  is  an  open-vessel  because  it  has  a  concavity 
and  because  the  concavity  is  upward-pointing. 

The  bowl  contains  tomato  soup. 

Remember  X. 

With  the  functional  definition  in  hand,  together  with  relevant  precedents,  the 
analogy  apparatus  is  ready  to  work  as  soon  as  it  is  stimulated  by  the  following 
challenge: 

In  E,  show  that  the  object  may  be  a  cup. 

This  initiates  a  search  for  precedents  relevant  to  showing  something  is  a  cup.  The 
functional  definition  is  retrieved.  Next,  a  matcher  determines  the  correspondence 
between  parts  of  the  exercise  and  the  parts  of  the  functional  definition,  a  trivial 
task  in  this  instance.  Now  the  verifier  overlays  the  cause  links  of  the  functional 
definition  onto  the  exercise.  Tracing  through  these  overlayed  cause  links  raises  three 
questions;  is  the  observed  object  stable,  is  it  an  open  vessel,  and  is  it  liftable.  All 
this  is  illustrated  in  figure  7. 

Questioning  if  the  object  is  liftable  leads  to  a  second  search  for  a  precedent, 
this  time  one  that  relates  function  to  form,  causing  the  suitcase  description  to  be 
retrieved.  The  suitcase  description,  shown  in  figure  8,  is  matched  to  the  exercise,  its 
causal  structure  is  overlayed  on  the  exercise,  and  other  questions  are  raised:  is  the 
observed  object  light  and  does  it  have  a  handle.  Since  it  is  light  and  does  have  a 
handle,  the  suitcase  description  suffices  to  deal  with  the  liftable  issue,  leaving  open 
the  stability  and  open-vessel  questions. 
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Figure  7.  ITic  cause  links  of  a  functional  description,  acting  as  a  precedent,  arc  overlayed  on  the 
exercise,  leading  to  other  questioned  links.  Note  that  all  of  the  cxericisc  description  is  physical, 
albeit  not  all  visual.  .)\crla\ed  structure  is  dashed. 


Thus  the  suitcase  precedent,  in  cITect,  has  a  rule  of  inference  buried  in  it.  along 
with  perhaps  a  lot  of  other  useless  things  with  respect  to  our  purpose,  including  the 
statement  about  why  the  suitcase  itself  is  useful.  The  job  of  analogy,  then,  is  to  find 
and  exploit  such  implicit  rules  of  inference. 

Checking  out  stability  is  done  using  the  description  of  a  brick.  A  brick  is  stable 
because  it  has  a  flat  bottom.  Similarly  ,  to  see  if  the  object  is  an  open-vessel,  a  bowl 
is  used.  A  bowl  is  an  open  vessel  because  it  has  an  upward-pointing  concavity. 
Figure  9  illustrates. 

At  this  point,  there  is  supporting  evidence  for  the  conclusion  that  the  exercise 
object  is  a  cup. 

Now  we  are  ready  for  the  final  task,  to  build  a  physical  model  of  the 
functionally-defined  concept.  This  is  done  by  constructing  an  if-then  rule  from  the 
links  encountered  in  the  problem-solving  process:  the  questioned  link  goes  to  the 
then  part;  the  links  at  the  bottom  of  the  transferred  CAUSE  structure  go  to  the 
if  part;  and  the  intermediate  links  of  the  transferred  CAUSE  structure  go  into  the 
unless  part1 

Figure  10  illustrates  the  basic  rule  formation  process. 

The  result  follows: 

Rule 

RULE-1 

if 

[OBJECT-9  HQ  LIGHT] 

[CONCAVITY-7  PHYSICAL-PART-OF  OBJECT-9] 

[HANDLE-4  PHYSICAL-PART-OF  0BJEC1-9] 

[BOTTOM-7  PHYSICAL-PART-OF  OBJECT-9] 

[CONCAVITY-7  AKO  CONCAVITY] 

[CONCAVITY-7  HQ  UPWARD-POINTING] 

[HANDLE-4  AKO  HANDLE] 

[BOTTOM-7  AKO  BOTTOM] 

[BOTTOM-7  HQ  FLAT] 

then 

[OBJECT-9  AKO  CUP] 
unless 

[[OBJECT-9  AKO  OPEN-VESSEL]  HQ  FALSE] 

[[OBJECT-9  HQ  LIFT ABLE]  HQ  FALSE] 

[[OBJECT-9  HQ  GRASPABLE]  HQ  FALSE] 

[[OBJECT-9  HQ  STABLE]  HQ  FALSE] 

case 

DEFINITION-1  DESCRIPTION-2  DESCRIPTION-3  DESCRIPTION-1 

At  first  the  unless  conditions  may  seem  strange,  for  if  all  the  ordinary  conditions 
hold  and  if  the  causal  connections  in  the  precedents  represent  certainties,  then 
none  of  the  unless  conditions  could  trigger.  However,  the  learning  system  assumes 
that  the  precedents  causal  connections  indicate  tendencies,  rather  than  certainties. 

'The  unless  p.irts  trine  from  the  links  lying  between  those  links  supplying  the  if  and  then  pans 
nl  the  rule,  l  or  a  i  ie  to  apply,  it  must  be  that  there  is  no  direct  reason  to  believe  any  link  in 
the  rule's  unless  part,  .is  explained  by  in  an  earlier  paper  (Winston  1982). 
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figure  9.  The  brick  precedent  .ind  the  howl  precedent  establish  that  the  object  is  stable  and  that 
it  is  an  open  vessel.  I  hc  cause  links  of  the  precedents  arc  overlayed  on  the  exercise,  leading  to 
questioned  links  that  arc  immediately  resolved  by  the  facts.  Overlayed  structure  is  dashed.  Many 
links  of  the  precedents  are  not  shown  to  avoid  clutter  on  die  diagram. 


Consequently,  from  the  learning  system's  perspective,  the  unless  conditions  must 
appear.  An  earlier  paper  gives  several  examples  where  similar  unless  conditions  are 
necessary  [Winston  1982]. 

For  a  trace  of  the  computer  interaction  behind  this  scenario,  see  note  1  in  the 
Appendix. 

Learning  What  a  Styrofoam  Cup  Looks  Like 

Styrofoam  cups  without  handles  are  described  by  another  rule  that  is  learned  in 
the  same  way  using  the  same  functional  description.  The  only  differences  is  that 
liftability  is  handled  by  way  of  a  flashlight  precedent  rather  than  by  the  suitcase 
precedent 

Let  X  be  a  description.  X  is  a  description  of  a  flashlight 
The  flashlight  is  liftable  because  its  body  is  graspable  and 
because  the  flashlight  is  light.  The  flashlight's  body  is 
graspable  because  it  is  small  and  cylindrical.  Remember 
X. 

Thus  the  learned  rule  is  as  follows: 

Rule 

RULE-2 

if 

[OBJECT-10  HQ  LIGHT! 

[CONCAVITY-8  PHYS ICAL -PART -OF  OBJECT-10] 

[BODY-9  PHYSICAL-PART-OF  OBJECT-10] 

[BOTTOM-8  PHYSICAL-PART-OF  OBJECT-10] 

[CONCAVITY-8  AKO  CONCAVITY] 

[CONCAVITY-8  HQ  UPWARD-POINTING] 

[BODY-9  AKO  BODY] 

[BODY-9  HQ  CYLINDRICAL] 

[BODY-9  HQ  SMALL] 

[BOTTOM-8  AKO  BOTTOM] 

[BOTTOM-8  HQ  FLAT] 

then 

[OBJECT-10  AKO  CUP] 
unless 

[[OBJECT- 10  AKO  OPEN-VESSEL]  HQ  FALSE] 

[[OBJECT- 10  HQ  LIFTABLE]  HQ  FALSE] 

[[OBJECT- 10  HQ  STABLE]  HQ  FALSE] 

[[BODY-9  HQ  GRASPABLE]  HQ  FALSE] 

case 

DEFINITION-1  DESCRIPTION-2  DESCRIPTION-4  DESCRIPTION-1 

For  a  trace  of  the  computer  interaction  behind  this  scenario,  see  note  2  in  the 
Appendix. 

Recognizing  Cups  and  Using  Censors 

We  now  have  two  descriptions  that  enable  direct  recognition  of  cups.  These  can  be 
used,  for  examp!  .  on  the  following  descriptions,  conveyed  by  ACRONYM  or  by 
the  natural  language  interface: 


Let  E  be  an  exercise.  E  is  an  exercise  about  a  light  object 
The  object  s  body  is  small.  The  object  has  a  handle.  The 
object's  bottom  is  flat.  Its  concavity  is  upward-pointing. 

Its  contents  are  hot.  In  E  show  that  the  object  may  be 
a  cup. 

Let  E  be  an  exercise.  E  is  an  exercise  about  a  light 
object.  The  object’s  bottom  is  flat.  Its  body  is  small  and 
cylindrical.  Its  concavity  is  upward-pointing.  Its  contents 
are  hot.  Its  body's  material  is  an  insulator.  In  E  show 
that  the  object  may  be  a  cup. 

For  the  first  of  these  two  exercises,  the  rule  requiring  a  handle  works  immediately. 
It  is  immaterial  that  the  contents  of  the  cup  are  hot 

For  the  second,  the  rule  requiring  a  small,  cylindrical  body  works  immediately. 
Again  it  is  immaterial  that  the  contents  of  the  cup  are  hot  since  nothing  is 
known  about  the  links  among  content  temperature,  graspability,  and  insulating 
materials.  Proving  some  knowledge  about  these  things  by  way  of  some  censors 
makes  identification  more  interesting. 

Suppose,  for  example,  that  we  teach  or  tell  the  machine  that  an  object  with  hot 
contents  will  not  have  a  graspable  body,  given  no  reason  to  doubt  that  the  object's 
body  is  hot.  Further  suppose  that  we  teach  or  tell  the  machine  that  an  object’s  body 
is  not  hot,  even  if  its  contents  are,  if  the  body  is  made  from  an  insulator.  All  this  is 
captured  by  the  following  censor  tides,  each  of  which  can  make  a  simple  physical 
deduction: 

Let  Cl  be  a  Censor.  Cl  is  a  censor  about  an  object.  The 
object's  body  is  not  graspable  because  its  contents  are 
hot  unless  its  body  is  not  hot.  Make  Cl  a  censor  using 
the  object's  body  is  not  graspable. 

Let  C2  be  a  censor.  C2  is  a  censor  about  an  object  The 
object's  contents  are  hot.  Its  body  is  not  hot  because  its 
body's  material  is  an  insulator.  Make  C2  a  censor  using 
the  object's  body  is  not  hot 

Repeating  the  second  exercise  now  evokes  the  following  scenario: 

Asking  whether  the  object  is  a  cup  activates  the  rule  about  cups  without  handles. 
The  if  conditions  of  the  rule  are  satisfied. 

The  unless  conditions  of  the  rule  are  checked.  One  of  these  conditions  states 
that  the  object's  body  must  not  be  plainly  ungraspable. 

Asking  about  graspability  activates  the  censor  relating  graspability  to  hot 
contents.  The  censor's  (/'condition  is  satisfied,  and  the  censor  is  about  to  block  the 
cup-identifying  rule.  The  censor's  unless  condition  must  be  checked  first,  however. 

The  censor's  unless  condition  pertains  to  hot  bodies.  This  condition  activates  a 
second  censor,  the  one  denying  that  a  body  is  hot  if  it  is  made  of  an  insulator.  This 
second  censor's  if  condition  is  satisfied,  and  there  are  no  unless  conditions. 


'Hie  second  censor  blocks  the  first  censor.  The  first  censor  therefore  cannot  block 
the  cup-identifying  rule.  The  rule  identifies  the  object  as  a  cup.  It  would  not  have 
worked  if  the  contents  were  hot  and  the  body  were  made  from  something  other 
than  an  insulator. 

For  a  trace  of  the  computer  interaction  behind  this  scenario,  see  note  3  in  the 
Appendix. 

Related  Work 

The  theory  explained  in  this  paper  builds  directly  on  two  sets  of  ideas:  one  set  that 
involves  a  theory  of  precedent-driven  learning  using  constraint  transfer  [Winston 
1979,  1981,  1982];  and  another  set  that  involves  model-driven  recognition  using 
generalized  cylinders  [Binford  1971,  1981. 1982;  Brooks  1981]. 

Another  important  precedent  to  this  paper  is  the  work  of  Freeman  and  Newell 
on  the  role  of  functional  reasoning  in  design.  In  their  paper  on  the  subject  [1971], 
they  proposed  that  available  structures  should  be  described  in  terms  of  functions 
provided  and  functions  performed,  and  they  hinted  that  some  of  this  knowledge 
might  be  accumulated  through  experience. 

Another  way  to  learn  what  things  look  like  is  by  near  misses.  Since  the  use  of  near 
misses  was  introduced  by  Winston  [1970],  several  researchers  have  offered  improved 
methods  for  exploiting  near  miss  information.  See  Dietterich  and  Michalski  [1981] 
for  an  excellent  review  of  work  by  the  authors,  Hayes-Roth,  and  Verc.  Also  see 
work  by  Mitchell  [1982]. 
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Appendix 


Note  1 

The  following  is  a  trace  showing  the  learning  of  a  handle-type  cup.  To  keep  things 
shorter,  interaction  with  censors  is  suppressed. 

In  E  show  that  the  object  may  be  a  cup. 

I  am  trying  to  show  [OBJECT-3  AKO  CUP] 

Supply  y,  n,  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DEFINITION-1  <  1.  links  > 

To  use  DEFINITION-1  I  need  to  know  if  [OBJECT-3  HQ  STABLE] 

I  am  trying  to  show  [OBJECT-3  HQ  STABLE] 

Supply  y,  n,  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DESCRIPTION-1  <  3.  links  > 

I  note  [BOTTOM-3  HQ  FLAT]  for  use  with  DESCRIPTION-1 
I  note  [BOTTOM-3  PHYSICAL-PART-OF  OBJECT-3]  for  use  with  DESCRIPTION-1 

I  note  [BOTTOM-3  AKO  BOTTOM]  for  use  with  DESCRIPTION-1 

The  evidence  from  DESCRIPTION-1  indicates  [OBJECT-3  HQ  STABLE] 

To  use  DEFINITION-1  I  need  to  know  if  [OBJECT-3  HQ  LIFTABLE] 

I  am  trying  to  show  [OBJECT-3  HQ  LIFTABLE] 

Supply  y,  n,  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DESCRIPTION-4  <  4.  links  > 

DESCRIPTION-3  <  3.  links  > 

I  note  [BODY-3  HQ  SMALL]  for  use  with  DESCRIPTION-4 

I  note  [BODY-3  PHYSICAL-PART-OF  OBJECT-3]  for  use  with  DESCRIPTION-4 

I  note  [80DY-3  AKO  BODY]  for  use  with  DESCRIPTION-4 

To  use  DESCRIPTION-4  I  need  to  know  if  [BODY-3  HQ  CYLINDRICAL] 

I  am  trying  to  show  [BODY-3  HQ  CYLINDRICAL] 

Supply  y.  n,  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  ? 

To  use  DESCRIPTION-4  I  need  to  know  if  [BODY-3  HQ  GRASPABLE] 

I  am  trying  to  show  [BODY-3  HQ  GRASPABLE] 

Supply  y,  n,  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  ? 

The  evidence  from  DESCRIPTION-4  does  not  indicate  [OBJECT-3  HQ  LIFTABLE] 

I  note  [HANDLE-2  PHYSICAL-PART-OF  OBJECT-3]  for  use  with  DESCRIPTION-3 

I  note  [HANDLE-2  AKO  HANDLE]  for  use  with  DESCRIPTION-3 

I  note  [OBJECT-3  HQ  LIGHT]  for  use  with  DESCRIPTION-3 

The  evidence  from  DESCRIPTION-3  indicates  [OBJECT-3  HQ  LIFTABLE] 
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To  use  DEFINITION-1  I  need  to  know  if  [OBJECT-3  AKO  OPEN-VESSEL] 

I  am  trying  to  show  [OBJECT-3  AKO  OPEN-VESSEL] 

Supply  y.  n,  ?,  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DESCRIPTION-2  <  3.  links  > 

1  note  [CONCAVITY-3  PHYSICAL-PART-OF  OBJECT-3]  for  use  with  DESCRIPTION 

2 

I  note  [CONCAVITY-3  AKO  CONCAVITY]  for  use  with  DESCRIPTION-2 
I  note  [CONCAVITY-3  HQ  UPWARD-POINTING]  for  use  with  DESCRIPTION-2 
The  evidence  from  DESCRIPTION-2  indicates  [OBJECT-3  AKO  OPEN-VESSEL] 

The  evidence  from  DEFINITION-1  indicates  [OBJECT-3  AKO  CUP] 

Rule  RULE-1  is  derived  from  DEFINITION-1  DESCRIPTION-2  DESCRIPTION-3 
DESCRIPTION-1  and  looks  like  this: 

Rule 

RULE-1 

if 

[OBJECT-9  HQ  LIGHT] 

[CONCAVITY-7  PHYSICAL-PART-OF  OBJECT-9] 

[HANDLE-4  PHYSICAL-PART-OF  OBJECT-9] 

[BOTTOM-7  PHYSICAL-PART-OF  OBJECT-9] 

[CONCAVITY-7  AKO  CONCAVITY] 

[CONCAVITY-7  HQ  UPWARD-POINTING] 

[HANDLE-4  AKO  HANDLE] 

[BOTTOM-7  AKO  BOTTOM] 

[BOTTOM-7  HQ  FLAT] 

then 

[OBJECT-9  AKO  CUP] 
unless 

[[OBJECT-9  AKO  OPEN-VESSEL]  HQ  FALSE] 

[[OBJECT-9  HQ  LIFTABLE]  HQ  FALSE] 

[[OBJECT-9  HQ  GRASPA8LE ]  HQ  FALSE] 

[[OBJECT-9  HQ  STABLE]  HQ  FALSE] 

case 

DEFINITION-1  DESCRIPTION-2  DESCRIPTION-3  DESCRIPTION-1 


Note  2 

The  following  is  a  trace  showing  the  learning  of  a  handle-type  cup.  Again,  to  keep 
things  shorter,  interaction  with  censors  is  suppressed. 

In  E  show  that  the  object  may  be  a  cup. 

I  am  trying  to  show  [OBJECT-2  AKO  CUP] 

Supply  y,  n.  ?.  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DEFINITION-1  <  1.  links  > 

To  use  DEFINITION-1  I  need  to  know  if  [OBJECT-2  HQ  STABLE] 

I  am  trying  to  show  [OBJECT-2  HQ  STABLE] 

Supply  y,  n.  ?.  r  *  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DESCRIPTION-1  <  3.  links  > 

I  note  [BOTTOM-2  HQ  FLAT]  for  use  with  DESCRIPTION-1 

I  note  [BOTTOM-2  PHYSICAL-PART-OF  OBJECT-2]  for  use  with  DESCRIPTION-1 

I  note  [BOlfOM-2  AKO  BOTTOM]  for  use  with  DESCRIPTION-1 

The  evidence  from  DESCRIPTION-1  indicates  [OBJECT-2  HQ  STABLE] 

To  use  DEFINITION-1  1  need  to  know  if  [OBJECT-2  HQ  LIFTABLE] 

I  am  trying  to  show  (OBJECT-2  HQ  LIFTABLE] 

Supply  y,  n,  ?,  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

DESCRIPTION-4  <  5.  links  > 

DESCRIPTION-3  <  3.  links  > 

I  note  [BODY-2  HQ  SMALL]  for  use  with  DESCRIPTION-4 

I  note  [BODY-2  PHYSICAL-PART-OF  OBJECT-2]  for  use  with  DESCRIPTION-4 

I  note  [BODY-2  AKO  BODY]  for  use  with  DESCRIPTION-4 

I  note  [BODY-2  HQ  CYLINDRICAL]  for  use  with  DESCRIPTION-4 

I  note  [BODY-2  PHYSICAL-PART-OF  OBJECT-2]  for  use  with  DESCRIPTION-4 

I  note  [BODY-2  AKO  BODY]  for  use  with  DESCRIPTION-4 

I  note  [OBJECT-2  HQ  LIGHT]  for  use  with  DESCRIPTION-4 

The  evidence  from  OESCRIPTION-4  indicates  [OBJECT-2  HQ  LIFTABLE] 

To  use  DEFINITION-1  I  need  to  know  if  [OBJECT-2  AKO  OPEN-VESSEL] 

I  am  trying  to  show  [OBJECT-2  AKO  OPEN-VESSEL] 

Supply  y.  n.  ?,  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  P 

I  find: 

0ESCRIPTI0N-2  <  3.  links  > 

1  note  [CONCAVITY-2  PHYSICAL-PART-OF  OBJECT-2]  for  use  with  DESCRIPTION- 

2 

I  note  [CONCAVITY-2  AKO  CONCAVITY]  for  use  with  DESCRIPTION-2 
I  note  [CONCAVITY-2  (IQ  UPWARD-POINTING]  for  use  with  DESCRIPTION-2 
The  evidence  from  DESCRIPTION-2  indicates  [OBJECT-2  AKO  OPEN-VESSEL] 

The  evidence  from  0EFINITI0N-1  indicates  [OBJECT-2  AKO  CUP] 

Rule  RULE-2  is  derived  from  DEFINITION-1  DESCRIPTION-2  DESCRIPTION-4 
DESCRIPTION-1  and  looks  like  this: 
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Rule 


RULE-2 

if 

[OBJECT- 10  HQ  LIGHT 3 

[CONCAVITY-8  PHYSICAL-PART-OF  OBJECT-10] 

[BODY-9  PHYSICAL-PART-OF  OBJECT-10] 

[BOTTOM-8  PHYSICAL-PART-OF  OBJECT-10] 

[CONCAVITY-8  AKO  CONCAVITY] 

[CONCAVITY-8  HQ  UPWARD-POINTING] 

[BODY -9  AKO  BODY] 

[BODY-9  HQ  CYLINDRICAL] 

[BODY -9  HQ  SMALL] 

[BOTTOM-8  AKO  BOTTOM] 

[BOTTOM-8  HQ  FLAT] 

then 

[OBJECT-10  AKO  CUP] 
unless 

[[OBJECT-10  AKO  OPEN-VESSEL]  HQ  FALSE] 

[[OBJECT- 10  HQ  LIFTABLE]  HQ  FALSE] 

[[OBJECT-10  HQ  STABLE]  HQ  FALSE] 

[[BODY-9  HQ  GRASPABLE]  HQ  FALSE] 

case 

DEFINITION-1  DESCRIPTION-2  DESCRIPTION-4  DESCRIPTION-1 


Should  I  index  it  as  a  rule? 
>  Y 


This  is  a  trace  of  the  system  as  it  identifies  a  styrofoam-type  cup  with  hot  contents. 
One  censor  turns  oflT  another,  preventing  it  from  turning  off  the  identification  rule, 
Rule-2. 

In  E  show  that  the  object  may  be  a  cup. 

I  am  trying  to  show  [OBJECT-8  AKO  CUP] 

Supply  y,  n.  ?,  r  =  rules,  p  =  precedents,  or  a  suggestion: 

>  r 

I  find  RULE-2  RULE-1 

I  note  [CONCAVITY-6  HQ  UPWARD-POINTING]  for  use  with  RULE-2 

I  note  [CONCAVITY-6  AKO  CONCAVITY]  for  use  with  RULE-2 

I  note  [CONCAVITY-6  PHYSICAL-PART-OF  OBJECT-8]  for  use  with  RULE-2 

I  note  [OBJECT-8  HQ  LIGHT]  for  use  with  RULE-2 

I  note  [BODY-8  AKO  BODY]  for  use  with  RULE-2 

I  note  [BODY-8  PHYSICAL-PART-OF  OBJECT-8]  for  use  with  RULE-2 

I  note  [B00Y-8  HQ  CYLINDRICAL]  for  use  with  RULE-2 

I  note  [BODY-8  HQ  SMALL]  for  use  with  RULE-2 

I  note  [BOTTOM-6  AKO  BOTTOM]  for  use  with  RULE-2 

I  note  [BOTTOM-6  PHYSICAL-PART-OF  OBJECT-8]  for  use  with  RULE-2 

I  note  [BCTTOM-6  HQ  FLAT]  for  use  with  RULE-2 

I  am  checking  the  validity  of  RULE-2  using  CENSOR-1 
to  check  whether  [[BODY-8  HQ  GRASPABLE]  HQ  FALSE] 

I  note  [CONTENTS-5  HQ  HOT]  for  use  with  CENSOR-1 

I  note  [CONTENTS-5  PHYSICAL-PART-OF  OBJECT-8]  for  use  with  CENSOR-1 

I  note  [CONTENTS-5  AKO  CONTENTS]  for  use  with  CENSOR-1 
I  am  checking  the  validity  of  CENSOR-1  using  CENSOR-2 
to  check  whether  [[BODY-8  HQ  HOT]  HQ  FALSE] 

I  note  [MATERIAL-2  AKO  INSULATOR]  for  use  with  CENSOR-2 
I  note  [MATERIAL-2  PHYSICAL-PART-OF  BODY-8]  for  use  with  CENSOR-2 

I  note  [MATERIAL-2  AKO  MATERIAL]  for  use  with  CENSOR-2 
Censor  CENSOR-2  shows  that  [[BODY-8  HQ  HOT]  HQ  FALSE] 
indicating  that  CENSOR-1  does  not  apply. 

Censor  CENSOR- 1  does  not  show  that  [[BODY-8  HQ  GRASPABLE]  HQ  FALSE] 

indicating  that  RULE-2  does  apply. 

No  censor  shows  that  [[BODY-8  HQ  GRASPABLE]  HQ  FALSE] 

The  evidence  from  RULE-2  indicates  [OBJECT-8  AKO  CUP] 


